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I. INTRODUCTION 


A. PURPOSE 

The purpose of this research is to determine the extent to which the Army’s test 
and evaluation centers external environmental assessment processes are adequate. Are 
their external environmental assessments capturing the trends and forces shaping the 


changing acquisition environment? 


B. RESEARCH QUESTIONS 

The research addresses a primary research question, as well as several secondary 
questions. The primary question is: To what extent do existing external environmental 
assessment efforts at the Army’s test centers adequately map the general and task 
environment? 

The secondary questions are: 

(1) What is the potential environment for the Army’s test centers? What are the 
emerging trends and forces, and what issues need to be considered? 

(2) What external environmental data should be collected and considered? Are 
there any significant threats or opportunities that are not being addressed by the test 


centers? 


G. SCOPE AND METHODOLOGY 
This thesis includes an analysis of the current strategic planning efforts at three 
test centers in the Army’s Test and Evaluation Command, specifically their 


] 


environmental assessments. These test centers have been selected to represent not only a 
broad cross section of the Army’s technical test mission, but also to reflect a portion of 
DoD’s Major Range Test Facility Base (MRIFB). The thesis examines the 
environmental factors affecting these test centers and address trends 1n emerging test and 
evaluation requirements. It also includes a review of the test center asessments. 
Recommendations to improve the environmental assessments conclude the thesis. 

The objective of this thesis is to identify whether or not current test center 
strategic planning at three of the Army’s test centers 1s responsive to the changing 
environment. To accomplish this, descriptions of the test centers and their environmental 
assessments are presented. Next, an independent assessment 1s conducted which relies on 
test center workload information, strategic plan reviews, management interviews, and 
policy reviews. Analysis of the data suggests that environmental assessments at all the 
test centers are inadequate. 

The methodology used in this research consisted of the following steps: 

(1) Conduct a literature search of books, magazine articles, CD-ROM systems, 


and other library information resources regarding external environmental 
assessments. 


(2) Interview Army Program managers to assess changing customer requirements. 
(3) Identify environmental factors affecting the Army’s test centers. 


(4) Obtain historical organizational, workload, and funding data from the test 
centers. 


(5) Obtain and review business and strategic plans from the test centers and 
TECOM. 


(6) Examine historical data and factors for trends. 


(7) Evaluate the impact of reforms and requirements on test center business 
environment. 


(8) Identify current external environmental assessment activities and the 
information they generate. 


(9) Develop an independent external environmental assessment. 


(10) Compare the test centers’ environmental assessments with an independent 
assessment. 


(11) Develop recommendations to correct any gaps in the test centers’ external 
environmental assessments. 


D. ORGANIZATION OF THE STUDY 

Chapter IT provides an overview of strategic planning to describe how external 
assessments fit in the strategic planning process. The chapter concludes with a detailed 
description of why external environmental analysis are important and how they should be 
conducted. 

Chapter III describes the methodology and rationale for selecting specific test 
centers. The chapter also provides descriptions of the interviewees—their positions and 
their influence on the test centers. It also includes a description of the missions for each 
of the three test centers, personnel make up, operating budgets, and levels of technology. 
A brief description of the Army’s Test and Evaluation Command (TECOM) is also 
provided. 

Chapter IV presents the results and data obtained from the test centers regarding 
their external assessment process and data collection efforts. These data include reviews 
of their strategic and business plans, and interviews with key strategic management 
personnel. The chapter describes both the formal and informal assessment efforts. 

Chapter V offers an independent assessment of the environmental assessments at 


the test centers. Identification of emerging business trends, such as changes in policies, 


acquisition reform impacts, and financial trends sets up points of comparison between 
what the test centers are doing and what they ideally could be doing. 

Chapter VI concludes the thesis with direct answers to the primary and secondary 
research questions. Areas for further research at the Army’s test centers are identified. 
E. EXPECTED BENEFITS OF THE STUDY 

This study offers recommendations to improve environmental assessments at the 
Army's Test and Evaluation Command test centers. It focuses on an important first step 
in the strategic planning process for DoD test organizations seeking to meet the 


challenges of changing test support requirements. 


HT. LITERATURE REVIEW 


A. INTRODUCTION 

This chapter provides an overview of strategic planning and embeds 
environmental assessments within the larger process. It begins by providing a brief 
history on the importance of strategic planning and then describes the overall strategic 
planning process. It closes by detailing the purpose, procedures, outcomes, and 


significant issues of conducting environmental assessments. 


B. STRATEGIC PLANNING AND ENVIRONMENTAL ASSESSMENTS 


y) 


The term “strategy” is derived from the Greek word “strategos,” which means 
“general of the army’. In ancient Greece, each tribe elected strategos who then formed a 
council to advise political rulers on how to win wars. Over time, the responsibilities of 
the strategos' council grew to include advising on civil management issues. These were 
the roots of strategic planning in today's businesses. [Ref. 1] 

As early as 1920, models like the Harvard Policy Model were developed to 
provide industry with strategic planning tools. These early models maintained direct 
relationships between a business strategy and its internal operations. But as business 
management processes matured during the late 1950s, the focus of strategic planning 
from the inside to external factors such as risk management, industry growth and market 
share. [Ref. 3] This next generation of models led to strategic decision making based on 


an analysis of both the internal and external environments. This new generation of 


models attempted to match an organization's internal strengths with its external 
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opportunities. During the 1960s, this generation of models became standard management 
tools for many corporations. [Ref. 3] 

What, exactly, 1s strategic planning? There seem to be as many definitions and 
models for strategic planning as there are web sites for strategic management consultants. 
But John Bryson [Ref. 4:p. 21] seems to sum them all up in one quote from hockey great 
Wayne Gretsky, who said, “J try to skate to where I think the puck will be.” In this 
remark, Gretsky implies that he continuously evaluated all the players in the game and 
constantly re-positioned himself to where he thought the puck would end up. 
Metaphorically speaking, Gretsky followed a simple strategic planning process that 
closely parallels that of today’s business organizations trying to stay competitive and 
sustain growth. Businesses today must evaluate their environment and plan to position 
themselves to be successful in the future environment. However, unlike hockey, the 
business environment is much more subjective and requires a systematic, thorough, and 
analytical planning approach to identify critical factors and develop strategic options. Dr. 
Berwyn Jones defines strategic planning in the government as: 

the identification of a desired long-range outcome and the development of 


a sequence of actions to achieve it, based on analysis of the organization's 
resources and its environment. [Ref. 5] 


Why is strategic planning important? Ronald Gunn provides one view of the 
advantages of strategic planning [Ref. 6]. He identifies six different benefits a strategic 
plan can provide if it is well thought out and includes input from all stakeholders. These 
benefits are: 

(1) Establishing Priorities. The strategic planning process allows an organization 

to define objectives that are the most critical and need to be the focus of its key 


programs. Therefore, the process focuses attention on the crucial issues and 
challenges the organization must face. 
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(2) Doing proactive problem solving. The strategic planning process allows the 
organization to anticipate problems and take proactive steps to reduce any 
negative impact. 


(3) Developing a commitment to a common purpose. The strategic planning 
process builds commitment throughout the organization to a common set of 
goals. 


(4) Setting organizational direction. The strategic planning process provides a 
direction for the organization and its employees to follow. 


(5) Setting the stage for effective decision-making. The strategic planning process 
ensures consistency in the allocation of the organizations resources. 


(6) Keeping management ‘light on their feet.” The strategic planning process 
promotes strategic thought and action. From this evolves a mental framework 
for constant re-assessment when unexpected environmental changes occur. 
This promotes a learning process that leads to a clearer understanding of 
organizational issues and the recognition of emerging environmental changes. 


Executed properly, strategic planning will yield valuable information and can 
provide some of the benefits identified by eo ae it cannot guarantee any of 
them. If strategic planning 1s not implemented carefully and with complete commitment, 
the process can be a waste of time and money. Bryson warns that strategic planning 
cannot be substituted for true leadership and that, without a leader and champion, the 
implementation of any strategies 1s likely to fail. [Ref 4] 

Jones points out that, although strategic planning is easiest to do in a stable 
environment, it is most useful when the environment is unstable. He draws an analogy 
between strategic planning and a sailor in a stormy sea: the sailor must constantly 
reassess his position and adjust his heading to make progress towards his destination 
(while isipeeine the risk of capsizing.) Just as Jones’s sailor can’t make progress 
without knowing his destination, an organization must have a clear understanding of its 
vision and strategy before sailing off. After all, “anyone can steer the ship when the sea 
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Bryson describes a detailed eight-step systems model for strategic planning. 
[There are actually ten steps in Bryson’s complete model, but since the model 
encompasses a large number of organizational issues, he recommends tailoring the model 
for specific applications. For the purposes of this thesis, one optional step is omitted, and 
two others are consolidated.] Figure 1 depicts a simplified summary version of the 
model. The model reflects a total strategic planning process that incorporates a 
rigorously thorough approach. Each of the eight steps recommended by Bryson is 
summarized and outlined here. [Ref. 4] Step four represents the environmental 
assessments phase of strategic planning critical to this thesis. An expanded description of 


the external environmental assessment 1s provided in Section B of this chapter. 


2. External 4a. External ia aoe ne Spel 7h) implement 
Mandates Environment P 
/ x 
J/ \ 7 
. . A) 
1. Planning >: identify Pap erent 
Process Strategic 8. Re-Assess 
Strategies 
Agreements Issues 
4b. Internal 
Environment 

























3. Stakeholder 
Mission and 
Values 






Figure 1. Strategy Change Cycle [Adapted from Ref. 4] 


Step 1. Initiate and agree upon a strategic planning process. Completion of this step 
allows high-level decision-makers to agree on critical aspects of the planning effort. Critical 
aspects that would typically be addressed during this step include schedule of key events, 


membership of teams, and demonstration of commitment. 


Step 2. J/dentify organizational mandates. This step requires the planning team to 
identify the formal and informal mandates placed on the organization. This phase is essential 


in determining the constraints and limitations within which the teams must work. 


Step 3. Clarify organizational mission and values. This step requires the team to 
conduct a stakeholder analysis to help them wnite or refine the organizations mission 
statement, which clanfies the organizations purpose. An organizations values, which clarifies 
the organizational core philosophy or integrity are also developed during this step. An 
Organizations mission and values, when combined with the organizational mandates, provide 


the justification for the organization's existence. 


Step 4. Assess the organization's external and internal environments. This step 
requires a thorough review of the factors both inside and outside the organization. The result 
of the analysis 1s a thorough understanding of the organization's internal strengths and 
weaknesses, as well as its external threats and opportunities. The external assessment portion 
of this step is the focus of this thesis and an expanded description is provided at section B of 


this chapter. 


Step 5. Identify the strategic issues facing the organization. As depicted in Figure 1, 
each of the first four steps leads into this phase. During this phase, the team attempts to 
identify the “critical challenges” and fundamental policy questions that will affect the 
organization's future. As specific issues are identified, they must be connected back to the 


mandates and environment, as well as to any consequences of not addressing the issue. 


Step 6. Formulate strategies to manage these issues and facilitate. During this step, 
actions, resource allocations, policies or programs are designed to address the strategic issues 


identified in step 5. 


Step 7. Review and adopt the strategic plans. This step allows all personnel to review 
and comment on the team's efforts. Modifications are discussed and incorporated prior to 


implementation approval. 


Step 8. Keassess strategies and the strategic process. During this step, the team 
addresses the implementation of the strategies and whether or not they are successful and 
should be continued. This assessment should also address the strategic planning process to 


improve the next round of planning. 


Ci EXTERNAL ENVIRONMENTAL ASSESSMENTS 

1. Introduction. 

What is the “external environment’? The external environment includes all the 
forces outside an organization that can influence its effectiveness or impact its future 
performance [Ref. 7]. These forces consist of those conditions and trends thrust upon an 
organization from the outside over which they have limited direct control. The external 
environment can be divided into two categories; the general environment and the specific 
task environment. 

Carson describes the general environment as consisting of “the broad conditions 
and trends in the societies within which the organization functions” [Ref. 7]. Carson and 
Bryson both depict at least four significant elements within the general environment; 


political, economic, social, and technical [Ref. 4 and 7]. These elements provide the 
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basis for an assessment of the general external environment described in section B.2 
below. 

The specific task environment consists of those conditions and trends peculiar to 
the specific organization and its work. Bryson breaks the task environment into the 
categories of resource controllers and competitors and collaborators [Ref 7]. Resource 
controllers include any external factors that can influence the organizations access to 
funds, personnel or equipment. The task environment also includes the relationships an 
organization has with its competitors and collaborators. The relationships with external 
resource controllers, competitors and collaborators should be evaluated and assessed in 
terms of the threats and opportunities they present. An assessment of these relationships 
can expose threats (or opportunities) that can not be readily identified during analysis of 
the general trends and forces. | 

Why is the external environment important? The output of an external 
environmental assessment 1s the identification of the threats and opportunities facing an 
organization. These opportunities and threats set the stage for identification of strategic 
issues and are ultimately the foundation for an organizations strategic planning effort. 
During this effort, organizational members attempt to match their strengths and 
weaknesses to opportunities and threats in order to meet the anticipated changes. In 
Bryson’s view, without a detailed environmental assessment, an organizations effort to 
develop effective strategic plans will likely be unsuccessful [Ref. 4]. If the external 
environmental assessment is poorly developed or not performed at all, then the entire 
strategic planning effort can be not only a waste of time and money but may also 


incorrectly allocate organizational resources. This misallocation could result in a more 
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rapid loss of any existing competitive advantage. Without strong external environmental 
assessments, an organization cannot develop effective strategic plans and in the long 
term, cannot remain effective, efficient or competitive. 

When should an external environmental assessment be conducted? The process 
of conducting research, gathering data, and analyzing emerging trends in the external 
environment is often referred to as “scanning.” Bryson considers environmental scanning 
to be the first “proactive” step in an organization's process of understanding and adapting 
to a changing environment [Ref. 4]. Environmental scanning should be performed before 
any attempt to identify opportunities and weakness is made and certainly before strategies 
and strategic issues are identified. In fact, scanning the continuously environment is 
ideal. Conducting environmental assessments periodically runs the risk of missing 


critical information until it is too late. 


De Assessments of General External Environmental 
How do you conduct an external environmental assessment? A conceptual model, 
provided by George Steiner, identifies three basic steps that comprise the external audit 
process [Ref. 8]. By combining Bryson’s and Carson’s general environmental elements 
within these steps, a methodical and structured assessment approach can be derived. The 
Steps to this approach are outlined here: 
Step 1. Analyze the customers. Obtain detailed information regarding 
who the industry customers are and why they buy the industries products or services. 


The analysis should include an assessment of how customer preferences, attitudes and 
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purchasing habits are changing. Finally, the analysis should explore opportunities to 
attract potential customers or markets. 

Step 2. Analyze the industry. Identify the trends and forces influencing 
the industry in the key general environment areas of; political, economics, social, and 
technological. Then determine how they are effecting the organization. A more detailed 
description of the types of information required for each element of the general 
environment is provided here. 

a. Political. The political element includes the changing political 
system and policies in which the organization must operate and the pressures and 
processes that influence the way they operate. For instance government regulations may 
have significant influence on some organizations and increased lobbying for changing 
regulations may reflect an external force on the organization. 

b. Economics. The economic element includes the current system 
of producing and distributing an organizations products or services. Some of the critical 
factors for any industrial business could be market trends, inflation factors, or interest 
rates. 

c. Social. The social element includes the norms, beliefs, and 
behaviors associated with the demographics of a society. For instance, the aging of the 
baby boomer group has a significant influence on many businesses. 

d. Technological. Technological elements evolve through 
breakthroughs in the industry that can change the ability of an organization to meet 
customer requirements and demands. For instance, the development of miniaturized 


electronics has had considerable influence on the entertainment industry. 
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Step 3. Analyze the information. A complete analysis of the information 
collected in steps one and two will identify the resulting opportunities and threats relative 
to the organization. This analysis is critical to the assessment process and produces the 
final product used to match organizational strengths and weaknesses and identification of 
Strategic issues. 

Carson recommends information derived from general audits, like this, be 
analyzed further to improve their usefulness towards identification of priorities and 
Strategies. He supports using an “External Factor Evaluation Matrix (EFE)” described by 
Smith and Gannon to quantify the effect of the threats and opportunities on 
organizational success. This quantification should allow critical elements to be readily 
identified and should minimize biases caused by subjective feelings and interpretations. 


(Ref. 7} Carson’s summary of the EFE Matrix are: 


(1) List key external factors identified in the external audit process. List 
the opportunities first and then the threats, being as specific as possible. 

(2) Assign each factor a weight that ranges from 0.0 (not important) to 1.0 
(very important). The weight indicates the relative importance of that factor to being 
successful in the firm's industry. 

(3) Assign a 1-4 rating to each critical success factor to indicate how 
effectively the firm’s current strategies respond to the factor. Ratings here are thus 
company based. 

(4) Multiply each factor’s weight by its rating to determine the weighted 


SCOTe. 
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(5) Sum the weighted values for each variable to determine the total 

weighted score for the organization. 
The result of the EFE matrix is a prioritized table representing the most 
significant drivers of organizational success. This table would be extremely beneficial 
when determining which environmental factors should have the most influence on the 


organizations strategic efforts. 


3. Assessments of Specific Task Environment 

The environment specific to the organization can be described in two areas; key 
resource controllers and competitors and collaborators [Ref. 4]. Analysis of these two 
areas allows the organization to separate the industry environment from the 
organizational specific environment. For instance, most government organizations must 
justify their budget requests and compete with other organizations for limited funding 
through a higher headquarters. The relationships these organizations maintain with their 
higher headquarters may be critical to the funding they receive. 

Evaluation of the organizational resource controllers should review, for example, 
who provides payments, receives payments, or provides discretionary funding. The 
resource controllers typically include; clients, customers, regulators, and higher 
management [Ref. 4]. 

Evaluation of competitors and collaborators should include a review of the forces 
generated through key competitors and partnerships. The product of the assessment will 
be identification of the important forces affecting the competitive and collaborative 


advantages available to the organization [Ref. 4]. 
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The specific task environment is a critical component of the external environment 
because it allows the organization to identify potential threats and opportunities that are 
peculiar to their organizations. With this information, the organization can better identify 


the strategic issues and strategies required to prepare for future changes. 
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UI. RESEARCH METHODOLOGY 


A. INTRODUCTION 

This chapter describes the methodology and rationale for selecting specific test 
centers and for selecting interview personnel. The chapter also includes a brief 
description of the three sample test centers, including their current missions, personnel 
make up, operating budgets, and levels of technology. A brief description of the Army’s 
Test and Evaluation Command (TECOM) 1s also provided. The chapter concludes with a 


summary of the limitations placed on the data analysis due to the methodology employed. 


B. TEST CENTER SELECTION 

Ideally, the selected test centers should be representative of DoD test ranges, but 
have roughly similar external environments to allow comparisons between them. This 
would also simplify the data gathering process. In selecting a test center sample set, the 
following criteria and rationale were utilized. 

(1) Select test ranges within the same service. This criterion allows comparison 
of data between the test centers and facilitates a manageable data collection effort. 

(2) Include test ranges with a broad spectrum of customers. This criterion 
ensures (or at least implies) a robust external environment. 

(3) Include test ranges that are part of the Major Range and Test Facility Base 
(MRTFB). This criterion results in data that can be subjectively compared with other 
service test ranges operating under the uniform MRTFB rules. 

(4) Ensure that selected test ranges have implemented some form of strategic 


planning. 
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A review of the DoD test center organizations indicated that the Army was the 
only service with a single command overseeing its test ranges. The Army’s Test and 
Evaluation Command (TECOM) became the focus of the sample selection effort because 
the overarching organization was expected to facilitate the data collection effort and 
provide a level of common external environmental factors. A review of the TECOM test 
ranges was completed to determine which ones fit the remaining criteria. A brief 
description of the Army’s Test and Evaluation Command and its test centers is provided 
here to identify the key differences between their test ranges. 

1. Test and Evaluation Command (TECOM) 

The Army’s Test and Evaluation Command (TECOM) currently falls under the 
Army Materiel Command (AMC). The AMC develops, buys, and maintains materiel for 
the Army and has nine major subordinate commands, including TECOM. TECOM is 
tasked to support the materiel acquisition process by conducting developmental tests for 
acquisition programs and by verifying the safety of weapon systems. TECOM consists of 
a headquarters and six test centers: White Sands Missile Range (WSMR), Aberdeen Test 
Center (ATC), Yuma Proving Ground (YPG), Redstone Technical Test Center (RTTC), 
Dugway Proving Ground (DPG), and the Aviation Technical Test Center (ATTC). These 
six test centers execute a combined workload of nearly ten million direct labor hours 
annually. The TECOM infrastructure includes over 4 million acres of land and over 4.6 
billion dollars worth of equipment. Each of the test centers is aligned with a specific test 
mission and primarily supports the acquisition of those types of weapon systems. Table 1 


provides a summary of the mission areas for all six of TECOMs test centers. [Ref. 9] 
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White Sands 
Missile Range 
(WSMR) 


Air Defense 
Smart Weap 
Direct Energy 
Space Systems 


Table 1. TECOM Test Range Missions 


Aberdeen 
Test Center 
(ATC) 


Fire Control 
Direct Fire 
Robotics 
Vehicles 


Redstone 
Technical 
Test Center 
(RTTC) 


Dugway 
Proving 
Ground 
(DPG) 


Yuma Proving 
Ground (YPG) 


Chemical 
Biological 
Smoke 
Obscurants 


Rockets 
Missiles 
Propulsion 


Natural Environment 
Desert (YPG) 
Tropic (TTS) 

Arctic (CRTC) 


Aviation 
Technical 
Test Center 
(ATTC) 


Aviation 


Indirect Fire 
Mines 
Aviation 
Air Delivery 


Sensors 
Transport 


Signature 


Vulnerability 
Electronics 
UAV 


Antennas 
Navigation 
Software 
Al 


LEGEND: 
TTS —Tropic Test Center AI —Artificial Intelligence 
CRTC - Cold Regions Test Center Weap - Weapons 
UAV — Unmanned Aerial Vehicle 





Under the oversight of the Office of the Director for Operational Test and 
Evaluation, the DoD establishes common operating rules for a set of 21 test installations, 
facilities, and ranges. These rules are designed to ensure that those DoD resources 
deemed critical for providing T&E information to DoD decision makers are focused on 
DoD support efforts. These 21 installations are referred to as the Major Range and Test 
Facility Base (MRTFB). [Ref 10] Of TECOM’s installations, WSMR, ATC, YPG, and 
DPG are included in the MRTFB. These four TECOM MRTFB installations were 
initially chosen as the test subjects for this research because they appeared to meet the 
screening criteria identified above. However, preliminary research revealed that DPG 
had limited workload, limited customer base, and a special congressional status that 
appeared to minimize its strategic planning efforts, so it was subsequently removed from 


the sample set. A summary description of each of the remaining three ranges is provided 


below. 
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pa White Sands Missile Range 

The White Sands Missile Range (WSMR), located in the Tuarosa Basin of south 
central New Mexico, was established in 1945 as White Sands Proving Ground to support 
testing and development of rocket technology and missile weapons. Encompassing 
almost 3,200 square miles, the WSMR is the largest military installation in the country. 
The WSMR’s primary mission is the support of missile development programs for DoD, 
NASA, and private industry. WSMR’s unique missile mission and its range mass have 
combined to provide a high-tech range infrastructure that has facilitated conduct of other 
types of testing, including directed energy weapons and RF vulnerability. The Electronic 
Proving Ground located at Fort Huachuca in Arizona is also an activity of WSMR. [Ref. 
SL 

At the end of fiscal year 1998, WSMR was staffed with 1,950 DoD civilians, 
approximately 379 military, and 1,390 contract employees, for a total of 3,719 employees 
[Ref. 12]. The DoD civilian workforce included 539 scientist and engineering positions 
with 14 doctorate degrees among them. [Ref 13] 

In fiscal year 1998, WSMR - roughly 4.1 million man-hours of direct 
work on test projects, with a large portion of the effort occurring in the area of missile 
development [Ref. 14]. The test center has an annual operating budget of approximately 


$401M [Ref. 15]. 


3. Yuma Proving Ground 
The Yuma Proving Ground is located in southwest Arizona along the Colorado 


River and encompasses over 1,300 square miles of rugged desert terrain. The proving 
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ground consolidates the Army’s natural environment testing by incorporating the Cold 
Regions Test Activity in Alaska and the Tropic Test Center currently in Panama. The 
proving ground provides a variety of support to Army developers and regularly conducts 
field tests for artillery, aviation, armor, vehicles, and air delivery systems. The testing of 
equipment at YPG dates back to the early 1940s, when it was responsible for testing new 
bridge and watercraft designs on the Colorado River for World War II efforts. [Ref. 16] 

At the end of fiscal year 1998, YPG was staffed with 690 DoD civilians, 
approximately 85 military, and 660 contract employees, for a total of 1,435 employees 
[Ref. 10]. The DoD civilian workforce education level included 113 bachelor degrees 
and no doctorate degrees. [Ref. 13] The YPG is Yuma County’s largest employer and 
the largest government consumer of local goods and services [Ref. 17]. 

In fiscal year 1998, YPG conducted over 1.3 million man-hours of direct work on 
test projects with over 65% of that occurring in the area of artillery, tanks, and armored 
vehicles [Ref 14]. The proving ground has an annual operating budget of approximately 
Sit (Ret): 

4. Aberdeen Test Center 

Aberdeen Test Center (ATC) is located on the east coast in central Maryland. 
ATC encompasses almost 500 square miles of land and water along the Chesapeake Bay. 
The test center is co-located with many of the Army’s laboratories at the Aberdeen 
Proving Ground. While the ATC is primarily a vehicle and direct munitions test center, it 
provides a variety of support functions for acquisition developers. Besides the vehicles 
courses and firing ranges required to support its core mission, ATC operates multiple 


high-technology facilities to evaluate hardware such as robotics, maritime systems, and 
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advanced transportation technology. The ATC was opened in 1918 as the Aberdeen 
Proving Ground when the Sandy Hook Proving Ground in Fort Hancock, New Jersey was 
closed due to increasing congestion in the New York Harbor. [Ref 18] 

In fiscal year 1998, the ATC had a DoD civilian staff of 994, a military staff of 
82, and 435 contract employees, for a total of 1511 employees [Ref. 12]. Of the civilian 
and military workforce, 243 had Bachelor's degrees and held scientist and engineering 
positions. Among them, five also held doctorates [Ref 13]. 

In fiscal year 1998, ATC conducted just under 2.1 million man-hours of direct 
work on test projects, with a large portion of the effort occurring in the area of ground 
vehicles and direct fire weapons [Ref 14]. The test center has an annual operating budget 
of approximately $129M; this does not include costs of base operations, which are funded 


directly to Aberdeen Proving Ground [Ref 15]. 


CG TEST CENTER MANAGEMENT INTERVIEWS 

The purpose of interviewing test center managers was to determine the process 
the test ranges were using to develop their strategic plans, with special emphasis on the 
processes used to characterize and document the external environment. The interviews 
also were intended to provide a first-hand perspective on each organization's key external 
environmental factors. Selection of individuals from each of the test centers was based 
on the position of the individual in the organization and his or her familiarity with the 
strategic planning process implemented at his or her facility. Preliminary telephone calls 
to the command staff of each organization indicated that each test center had assigned 


specific internal activities and personnel to facilitate development of the strategic plans. 
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One individual from each test center was interviewed regarding the external assessment 
process their test centers conducted during their strategic planning efforts. All three of 
these personnel worked in the quality or business planning groups and were key members 


of the strategic planning teams for each test center. 


D. PROGRAM MANAGER INTERVIEWS 

Key customers for each of the test ranges were determined to identify commodity 
areas having the largest impact or influence on each of the ranges. Discussions with 
these customers were intended to provide subjective trends regarding application of 
acquisition reform policies on their development programs, with specific emphasis on 
implications for the test ranges. 

The key customers were identified through a review of test center workload by 
customer type. Figures 2 through 4 provide a graphical representation of the FY98 
workload for each range, sorted by the Training and Doctrine Command’s mission areas 
used by TECOM to track workload. The data used to develop these figures are provided 
in Appendix A and were derived from the OTARDA data call for development of the 
President's FY 00 budget. 

Key customer areas were identified as those whose mission areas exceeded ten 
percent of each range's total FY98 workload. The resulting areas were then cross- 
referenced with the Program Executive Offices (PEO) or major commands responsible 
for those general areas of system development. Table 2 provides a summary of the 
resulting important customers for each range correlated to a PEO. Once these areas were 


identified, program management personnel from these PEOs with acquisition knowledge 
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and test range experience were selected for interview. Five customer interviews were 
completed with either program managers or assistant product managers for test and 
evaluation. These interviews were conducted with customers from the Aviation, Combat 


Service Support, Fire Support, and Close Combat Heavy mission areas. 
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Figure 2. WSMR Primary Mission Areas 


YPG Direct Workload by Mission AreaF Y98 
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Figure 3. YPG Primary Mission Areas 
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ATC Direct Workload by Mission Area FY98 
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Figure 4. ATC Primary Mission Areas 


Table 2. Key Customer Areas by PEO 


Key Customer Area 
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E. LIMITATIONS 



























Due to the methodology used to select the test ranges and interviewees, several 


limitations must be considered in the analysis of any collected data or their application to 
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other DoD ranges. These limitations generally fall into the four categories discussed 
below. 

1. Single Service Selection 

Selecting only Army test ranges will bias results and subsequent conclusions 
towards the Army’s test range environment. Although the external environment at test 
ranges is very similar among the services, each has a significantly different system. 
There was no attempt to identify the strategic planning processes of the Navy or Air 
Force test ranges. Even with the bias towards Army test range strategic planning, it is 
likely that the major external influences are common, or at least similar, to all of DoD's 
open-air test ranges. As such, it may be possible to apply the conclusions and results 
regarding the future environment to other DoD test ranges, although generality of the 
sample has not been determined. 

2. Customer Relevance 

Input from customers was limited to interviews with only five customers from the 
primary customer base. There was no attempt to statistically quantify trends through 
large customer surveys. Nor was there an attempt to include smaller customers, even 
though they may offer the most significant opportunity for future growth. It is also 
important to note that several of those interviewed are no longer active in the program 
offices they were selected to represent. These personnel, and their lack of program 
currency, may not provide a totally accurate portrayal of current customer perspectives 
on future trends for test center requirements. However, this concern is minimized since 
all interviewees were either current program mangers or are still active in the acquisition 


field. Therefore, the customer data set should be used only to identify overarching 
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changes in customer requirements, and not to focus on specific requirements for each 
customer. 

ay Strategic Planning Interpretation 

As Bryson describes it, the act of strategic planning is more important than the 
plan itself [Ref 4]. The strategic plans provided by the test ranges may not incorporate 
the wealth of information discussed and disseminated during the planning phase. This 
effect, coupled with the subjectivity of the interviewees’ descriptions of the processes, 
may bias any interpretations of the test ranges' external assessment processes. Thus, the 
external environmental assessments may understate what was actually discussed in the 
meetings. 

4. Other External Stakeholders 

Only the key common external stakeholders are addressed in the independent 
assessment in the analysis chapter (Chapter V1, Section C), and only brief consideration 
is given to other stakeholders. Some of these other stakeholders may have significant 
influence at all of the ranges, but their influence is typically localized to individual 
ranges. For instance, the local community near ATC exerts a powerful influence over the 
range because of the community's size, proximity and political strength. ATC has had to 
deal with noise and environmental complaints from residential areas located near the 
range boundaries and across the Chesapeake Bay. These residential areas are often made 
up of powerful politicians who can, and apparently do, present a significant strategic 
challenge. The local community is a much less significant external influence at WSMR 


or YPG, which are more isolated and experience less residential encroachment. 


Zl 
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IV. RESULTS 


A. INTRODUCTION 

The sections below provide a summary of each test center's formal and informal 
assessment process, assessment results, conclusions, and a summary statement of 
Opportunities and threats. The informal results provide the basis for evaluating the 
environmental assessment process at each range and for comparison to an independent 
external assessment in Chapter V. 
B. FORMAL EXTERNAL ENVIRONMENTAL ASSESSMENT 

(1) Formal Process. The test centers did not implement any formal steps to 
assess their external environment. 

(2) Formal Data Collection. The test centers did not formally collect any 
environmental data. 
Cc; INFORMALLY DERIVED EXTERNAL ENVIRONMENTAL 

ASSESSMENT 

The strategic planning teams at each of the test centers identified their future 
vision for each organization. In doing this, the teams discussed the external environment 
in terms of broad trends and emerging policies. However, the team did not attempt to 
formally collect or analyze any data regarding the test center’s business environment. 
Based on intuition, experience, information familiarity, and industry knowledge, group 


discussions identified a set of trends and forces affecting their businesses. 
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i White Sands Missile Range 

The “facts” and “assumptions” from WSMR’s strategic plan provide some insight 
as to their assessment of the trends and forces affecting their future. They appeared to 
have identified the general trends and forces outlined in Table 3. 


Table 3. WSMR Informal Environmental Assessment Results 
















2. Yuma Proving Ground 
The discussion area of YPG’s strategic plan provide some insight as to their 
assessment of the trends and forces affecting their future... They appeared to have 


identified the general trends and forces outlined in Table 4. 


Table 4. YPG Informal Environmental Assessment Results 
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3. Aberdeen Test Center 
ATC’s strategic plan provided some insight as to their assessment of the trends 
and forces affecting their future. They appeared to have identified the general trends and 


forces are outlined in Table 5. 


Table 5. ATC Informal Environmental Assessment Results 


Trends and Forces 
Increasing reliance on modeling and simulation 


Increasing requirement for technology expertise 
Increasing use of partnerships 





D. INFORMALLY DERIVED OPPORTUNITIES AND THREATS 
The opportunities and threats identified by the test centers are outlined below. 
These opportunities and threats were derived from both the strategic plans and interviews 
with test center personnel. 
1. White Sands Missile Range 
a. Threats 
Mission encroachment and competition from training activities and other 
test ranges are a threat to maintaining viability as a major range and test facility base, and 
they can drive up costs to customers. 
b. Opportunities 
(1) Technology provides an opportunity to stay competitive as 
resources decline. 
(2) Emphasis on command, control, communication, 
computers and intelligence (C4I) provides an opportunity to increase workload if 


capabilities continue to meet requirements 


(3) Integration of testing and training is an opportunity to 

maximize utilization of capabilities. 
pas Yuma Proving Ground 
a. Threats 

(1) Increased competition is a threat to workload projections. 

(2) Reduced resources are a threat to YPG’s capability to 
perform its mission. 

(3) Unfunded mandates will threaten already reduced budgets 
and result in reduced operations and maintenance funds. 

(4) YPG’s lack of industry exposure threatens the ability to 
increase market size. 

(5) YPG’s lack of technology and industry standards expertise 
may limit attraction of new customers and reduce return customer base. 

(6) The poor capital investment process threatens to prevent 
effective investment 1n principle customer requirements. 

b. Opportunities 

(1) Training support provides new market opportunities for 
YPG capabilities. 

(2) Operational testing provides new market opportunities for 
YPG capabilities. 

(3) Commercial research and development agreements provide 
an opportunity to increase capabilities and exposure to industry at a low cost to the 


installation. 
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(4) Partnering with government developers provides the 
opportunity to demonstrate YPG’s credibility and capabilities. 

(5) The use of Public/Private Ventures provides the 
opportunity to increase use of the range's assets and attract high-technology markets. 

(6) Safari tests may allow YPG personnel to demonstrate 
capabilities and credibility to a broad spectrum of potential customers. 

(7) Private industry testing may foster the way towards 
developing industry exposure and new market potential. 

3. Aberdeen Test Center 
a. Threats 


None identified. 


b. Opportunities 

(1) Maintaining a lead in the development of test standards 
provides the opportunity to influence industrial and commercial test sectors. 

(2) Partnering with other test industry stakeholders allows the 
opportunity to demonstrate capabilities and increase the effectiveness of the ATC 
workforce. 

(3) Increasing customer focus provides the opportunity to 
improve customer relations and increases the likelihood of customers returning 


with additional work. 
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V. ANALYSIS 


A. EVALUATION OF THE ENVIRONMENTAL ASSESSMENT PROCESS 
(1) General Process. None of the test centers conducted formal external 
environment analyses. However, during the strategic planning process, each utilized 
expert personnel who offered their opinions and advise on Key issues affecting their test 
centers. The information on the external environment was therefore generated informally 


as a byproduct of the strategic planning process, not formal steps in the process. 


(2) Data Collection Effort. 

The ranges made almost no effort to collect external environmental data. The 
data utilized were limited to workforce feedback, customer feedback, staffing trends and 
some policy forces. These sources help identify the high-visibility strategic issues, but 
barely scratch the surface of the test centers’ external environment. For example the 
decreasing workload in close combat heavy was missing as noted in the next section. As 
a result, they miss many potential opportunities and threats, which, if identified, might 
allow the center to develop better strategies. If the competitive nature of the test and 
evaluation industry persists, as the test ranges predict, identifying and addressing the 


unidentified opportunities could give them a competitive advantage in the future. 


B. MY ENVIRONMENTAL ASSESSMENT 
Using George Steiner’s three-step external audit model [Ref. 8], an executive 


level external environmental assessment was completed. The results of this assessment 
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are outlined below and then used for comparison to the test centers assessments identified 
in Chapter 4, section D. 
1. Analyzing The Test Center Customers 

a. Who are the customers? 

Customers of the test ranges are organizations that require test and 
evaluation support. Customers are primarily military weapon system developers, but 
small percentages are also from private industry with commercial developments. Over 
75% of the workload at TECOM originates from Army developers, while approximately 
20% originates from the Navy or Air Force, and about 3% is performed for foreign and 
private customers. 

b. Why do they buy the product? 

Customers come to the test centers to evaluate the status of their systems 
and to determine the adequacy of their designs to meet the intended requirements. Many 
of the customers require large air or land space to allow full field testing of their 
equipment and have limited options available. The ranges provide large test areas, 
munitions handling infrastructures, and, sometimes, the expertise required to evaluate 


system performance. 


C: How will it change? 

Interviews with several customers indicate that the inherently high costs of 
system-level field-testing has led them to reduce the amount of field testing whenever 
possible. Up until the mid 1990s, their control over the types and amount of field-testing 


was limited because of mandatory test requirements and determinations made by other 
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government agencies. Recent acquisition reform changes have allowed them much more 
flexibility in determining how much field-testing is required, and they expect to see even 
less field-testing in the future. Several customers also indicated that acquisition reform 
changes had allowed them to leverage the expertise of their development contractors to 
define and execute test programs more efficiently, rather than task engineers at the test 


ranges. 


d.° Are there other potential customers or markets? 

The use of test centers for other than military customers on any large 
scale is limited by law and policy. For instance, use of the ranges by foreign militaries is 
restricted by foreign military sale regulations. Providing service directly to foreign 
companies is not allowed unless they are teamed with a U.S. company, and providing 
services to commercial U.S activities requires non-competition assessments as well as 
special contract approval procedures. The ranges primarily cater to developmental 
testing, but their large open-air ranges may support operational testing and training 


programs. 


De Analyzing The Test Center Industry 
Using Bryson's [Ref. 4] environmental scanning data elements, this industry 
analysis is subdivided into forces and trends, resource controllers, and competitors and 


collaborators. 
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a. Forces and trends 

Forces and trends refer to those major forces outside the organization that 
may impact the success of the test centers. The primary trends and forces influencing all 
three of the test ranges’ future operations are categorized into the broad areas of political, 
economical, social and technical environments. Each of these areas is outlined below, 
and current trends are projected from available data. 

(1) Political. The political element includes the political system in 
which the test centers must operate and the pressures and processes that influence the 
way they operate. 

In response to congressional cutbacks, the DoD leadership has 
attempted to identify sources of cost savings and areas to gain efficiencies. They 
identified test range and laboratory infrastructure as one such area. Over the past several 
years, they have implemented several committees, programs, and policies to consolidate 
the major investment processes and reduce redundancy between the test ranges. These 
policies and programs represent the crux of the political trends and forces coming from 
DoD and Congress. The salient points of the key policies and programs are briefly 
described here. 

The Under Secretary of Defense (USD) for Acquisition and 
Technology sponsored the Foundation Initiative 2010. This initiative identifies core tools 
and programs test ranges should build their future investments around. The initiative 
relies on the tools and considerable partnering among the ranges to obtain efficiencies. 

While addressing the International Test and Evaluation 


Association, Dr. Paul Kaminski talked of the requirement to reinvent DoD testing and 
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evaluation. In his remarks, he commented that “test and evaluation related problems are 
cited as the major culprit causing many programs to experience excessive schedule delays 
and enter this downward mischief spiral.” [Ref. 20] He went on to explain his expectation 
that the test and evaluation community will go through a cultural change beginning at the 
working levels to improve the weapon systems and field them in a shorter period. 

In 1997, Kaminski also approved and strongly endorsed a program 
called Simulation, Test and Evaluation Process [Ref 20]. This program requires the 
acquisition community to develop and implement simulation and modeling activities to 
help reduce the quantity of field testing, increase system quality, and facilitate early 
evaluation. 

Also in 1997, Dr. Patricia Sanders, then director of Test, Systems 
Engineering and Evaluation for the USD A&T, addressed a congressional subcommittee 
on Military Research and Development. In her remarks, she described the challenging 
environment the test and evaluation community could expect to see in the future. Her 
description included: decreasing modernization budgets; fewer resources for engineering 
and test; fewer investment dollars for enhancing capabilities; and inherently more 
sophisticated and complex weapon systems. Sanders indicated that the objective of the 
test ranges and DoDs policies would be to reduce resources, time, and risk associated 
with fielding systems by teaming, implementation of simulation, leveraging 
modernization dollars, and enhancing productivity of the test and evaluation facilities. In 
partial support of the simulation initiatives, Sanders described the work distribution at the 
test ranges versus developmental costs of weapon systems. In her view, the test ranges 


accounted for 30% of the acquisition work in DoD, but accounted for 60% of the cost. 
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She also described how the test range personnel had been reduced by 35%, but that more 
cuts were required. The thrusts of her comments were to eliminate field-testing through 
implementation of simulation and additional reductions in personnel. [Ref. 21 and 22] 

In summary, there appear to be several recurring themes evolving 
in the test centers' political arena: reduce field-testing; reduce personnel at the test 
centers; implement simulation and modeling processes; develop partnerships; and 
improve timeliness. 

(2) Economics. For the test centers, the economic element 
includes the current system of producing and distributing their services. The primary 
economic areas affecting the test ranges involve the distribution of work, funds and 
personnel among them. While these factors are primarily dictated by higher commands, 
they may ultimately be the result of political forces, and changes may follow political 
trends. For this analysis they are considered economic factors. 

Workload at the ranges 1s measured in terms of “direct workload” 
or the number of labor hours provided in direct support of a paying customer. For most 
of the test centers, direct workload generates income that subsidizes a large percentage of 
their overhead costs. Figure 6 provides a summary for each test center of the actual 
workload since FY95 and the projected workload through FY08. The projected workload 
presented in Figure 5 is derived by TECOM based on historical workload trends and 
POM estimates for RDT&E programs [Ref. 14]. Appendix A includes complete 
workload projections by mission area, fiscal year, and test center. These workload 
estimates are typically used to determine yearly indirect funding for each of the test 


ranges. The trends depicted for each of the ranges represents a roughly constant workload 
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from FY99 through fiscal year 2008. Although there are only four years of historical 
data, they indicate the trends at WSMR may be more volatile than the projections 
indicate. One limitation of the TECOM projections may be the tendency for customers to 


do less testing, which would cause these projections to be overstated. 
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Figure 5. Test Center Workload Projections 


Table 6 shows an increased level of workload detail for each of the test ranges by 
incorporating specific mission areas and the long-term projections associated with these 
areas. Figure 6 provides a graphical presentation of those mission areas projected to 
increase. Table 6 and Figure 6 together provide insight as to the growth potential of 


specific support areas and could help identify specific opportunities for the test centers. 
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Figure 6. Increasing Mission Areas for TECOM 


Table 6. Workload Trends By Mission Area 
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The TECOM projections for staffing levels at each of the test centers are 
identified in Figure 7. These projections include the total number of military, civilian, 
and contract personnel. The projections indicate a general decline at each of the test 


centers through FY02, even though workload remains fairly constant. 
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Figure 7. Test Center Projected Staffing Levels 


Figure 8 identifies an indicator of the trend towards using contract personnel at 
the test centers. This trend indicates that, in the future, contract personnel will make up a 
much larger percentage of the workforce than civilians will. This leads to the conclusion 


that the reductions in staffing projected by TECOM focus primarily on government 


civilians. 
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Figure 8. Test Center Contractor Staffing Levels 


Funding for the ranges is provided by three major sources: direct funding 
from customers; improvement and modernization funding; and institutional funding from 
TECOM. Using TECOM funding forecasts, a funding profile for each of the test centers 
is provided in Figures 9 through 11. These profiles reflect slightly decreased funding for 
WSMR and ATC, while YPG's funding profile appears to increase due to an influx of 


modernization funds. 
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The economic trends at the test centers indicate that there will be 
fewer government personnel and more contract personnel conducting a roughly constant 
workload. The workload areas may shift, with more focus on combat service support, 
ammunition, aviation, and engineering and mine warfare, but with less emphasis on close 
combat, intelligence and electronic warfare, and communications. The funding available 
to execute this workload will gradually decrease. 

(3) Social. The social element includes the norms, beliefs, and 
behaviors associated with the demographics of a given area or region. Since the ranges 
are geographically dispersed and have significantly different demographic makeup, this 


assessment focuses only on the common and broad elements of the social environment, 
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specifically the trend towards union representation, increased union influence, and U.S 
cultural norms. 

All three of the test centers are seeing their employees increasingly 
represented by union groups. The centers expect that this trend will continue and that, as 
the unions begin to represent more personnel across the country, they will have more 
influence over organizational decisions. Both WSMR and YPG included union 
representation in their strategic planning sessions, and YPG includes union members on 
its executive steering council. Increased diversity in the workforce, along with increased 
public concern for quality of life and environmental issues, may lead to increased 
demands for flexibility and workplace improvements [Ref. 4]. 

(4) Technological. Technological elements evolve through 
breakthroughs in the test and evaluation industry that can change the ability of a test 
center to support its customers. 

Weapon systems developers have seen the technology they apply 
to their weapon systems become increasingly complex at all levels. Over the past ten 
years, there have been quantum leaps in computer, communication, sensor, and software 
capabilities. These technologies are also being horizontally integrated to form 
increasingly more complex weapon systems. Old systems, such as gravity bombs, were 
typically stand-alone systems used to meet singular requirements. In today’s world of 
“smart” weapon systems, a system may incorporate elements of many technologies to 
meet the demands of increased performance and multiple requirements. One other 
significant technology trend affecting the test centers is the emphasis on simulation and 


modeling in place of field-testing. According to Dr. Kaminski, then the Under Secretary 
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of Defense for Acquisition and Technology, DoD expects everyone within the test and 
evaluation community to ensure that modeling and simulation become an integral part of 
the acquisition process [Ref 21]. 

The new technologies not only drive the test and evaluation 
community to develop increasingly more complex instrumentation systems to assess the 
weapon systems, but they also require constant academic schooling to maintain current in 
the new technologies. At the test center level, this becomes harder as the new 
technologies are rapidly developed and incorporated into weapons system design. The 
integration of technologies also challenges the test centers to develop capabilities in areas 
outside of their normal core capabilities. This trend could lead to extra capabilities that 
generate the opportunity to enter additional customer markets, thus leading to increased 
competition among DoD’s test centers. 

One indicator of the test centers' capability to handle the increased 
technological requirements is found in the education level of the workforce. Figure 12 
depicts, for each test center, the historical percentage of the government workforce that 
has at least a Bachelor of Science degree in an engineering field. This figure indicates 


that the technical workforce is slowly declining. 
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Figure 12. Test Center Engineering Staff 


To meet the requirements of rapidly increasing technology, test 
centers must develop capabilities beyond the scope of their current specialty areas. If the 
ranges develop additional capabilities they can expect increased competition for test and 
evaluation work between all the DoD ranges. The ranges face a challenge in maintaining 
their technology capability given the reduction in staffing and specifically the trend of 
fewer engineering staff. 

b. Resource controllers 

The TECOM is the hierarchical resource controller for each of the test 
centers, and the test customers are the functional resource controllers. However, 
resources ultimately can be traced to the budget for weapon systems development. The 
development of weapon systems justifies the core overhead operations at each of the test 
centers, which is provided through the hierarchical chain of command to TECOM and 
then distributed to the test centers. The customers are primarily weapon systems 
developers who use the range's direct services and are the driving force behind the 
numbers of employees, types of instrumentation, and amount of direct funding the range 


receives. 
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The TECOM distributes indirect and modernization funds based on 
historical indicators and projected performance. The test centers have always been 
subordinate to TECOM, but with decreases in core operating funding from Congress, the 
test centers are beginning to become more independent of TECOM. In October 1999, an 
Army initiative to consolidate testing activities will become effective. As a result of the 
consolidation, TECOM will become the Development Test Command (DTC) under the 
Army’s Test and Evaluation Command (ATEC). This consolidation changes the entire 
reporting structure. Prior to this time, TECOM reported directly through AMC to the 
Vice Chief of Staff of the Army (VCSA). The reorganization results in TECOM reporting 
directly to what was the Operational Test and Evaluation Command (OPTEC), then the 
VCSA. This change in reporting structure may result in critical budget reviews and 
possible reallocation not only of funding resources but also of personnel and equipment 
resources at all the test centers. 

Distribution of customer funds is dependent on competition, capability, 
reputation, and the past experience each customer has with all the ranges. Since there are 
limited funds and fewer development programs, the test centers perceive a zero sum gain 
environment. They perceive a fixed amount of testing can or will be supported by 
weapon systems developers and that anything they lose is gained by another test centers, 
or vice versa. These factors and test center parochial interests are fueling intense 
competition for customer funding. 

Cc: Competition and collaborators 

It is evident in the test centers’ marketing developments and the resulting 


customer reactions that competition among the test centers is increasing rapidly. Each of 
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the test centers is developing marketing programs to identify new and maintain old 
customer bases. As a result, customers recognized the extent of their alternatives and 
began issuing bid requests to multiple test centers to identify the best value for their 
program. Five to ten years ago, this environment was unheard of, and TECOM 
controlled assignment of test locations. The competitive environment is driving many 
test centers to redesign their methods of meeting customer expectations and to tailor their 
products to customer needs. 

This competitive environment may be _ preventing large-scale 
implementation of OSD-sponsored partnering relationships, but there appears to be a 
trend towards developing geographical partnerships among the test centers. The 
southeastern corridor of excellence partnership which has agreed to collaborate on 
marketing joint capabilities to potential customers. The southeastern corridor of 
excellence partnership currently includes the Aberdeen Test Center, Redstone Technical 
Test Center, the Aviation Technical Test Center, and Eglin Air Force Base. Ranges 
located in the western U.S have a much looser coalition but appear to be moving in the 
same direction. Whether the coalitions emerge as a competency-based partnership or a 
geographical marketing effort will be determined by their success in attracting customers 


and how effectively and efficiently they can meet their needs. 
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S: Analyzing The Information 

a. Test Center Opportunities 

The significant opportunities identified through this industry analysis are 
outlined below. Each opportunity includes a brief description of the industry forces et 
indicators correlating to the opportunity. 

Increased marketing to private industry provides an opportunity to 
increase workload and maintain low costs to customers through overhead subsidy. 
Supporting tests for private industry currently represents only a small portion of the total 
workload. Increasing this market area offers the opportunity to replace declining defense 
testing. 

Using the test center to support operational testing and training activities 
can provide opportunities to increase utilization of range assets and resources and to 
reduce operating costs. There is political support for this effort and there is an interest by 
these activities in these test ranges, so the environment would clearly support and 
encourage those initiatives. 

Early partnering with developers can improve test center reputations, 
establish test center issues, and improve the service provided to the developers. The test 
and evaluation community generally suffers from a poor reputation, and there is political 
support to include testers early to reduce costs, improve performance and reduce time to 
field. 

Partnering with other test centers may allow a center to leverage its core 
competencies and investment funding to maximize effectiveness and efficiency. While 


investment spending and staff have decreased, workload has remained constant. 
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Partnering could allow test centers to leverage their specialties and jointly provide better 
services instead of becoming “jacks of all trades.” The resulting integration of the test 
centers may allow them to take over some of the test planning functions from the 
program office. 

Incorporation of simulation and modeling capabilities may help test 
centers regain some of the workload being lost as a result of the use of modeling and 
simulation. There is a rising trend of implementing modeling and simulation to reduce 
the requirements for field-testing. This trend 1s supported in the political environment 
and has the potential to improve customer support. 

There are opportunities to increase the customer base in the Engineering 
and Mine Warfare (EMW), Ammunition (AMM), Combat Support Systems (CSS), and 
Aviation (AVN) test support areas. TECOM projections for support in these four areas 
show the largest growth potential at the Army test centers [See Table 6]. 

Increased use of a contractor workforce mitigates the impact of lost 
government staff and engineering resources, while establishing flexibility to respond to 
dynamic workload changes. Staffing trends indicate that test centers are beginning to 
rely more on contractor support, who can offer a significant advantage in the areas of 
workforce size flexibility [See Figure 8]. 

The YPG has an opportunity to develop a improve their modernization 
effort. The YPG was the only test center of the three projecting an increase in 
modernization funding over the next five years [ See Figure 10]. 

Trends indicate that the test centers can expect more competition as the 


budget becomes tighter and fewer customers require their services. Test centers may be 
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able to take advantage of the emerging competitive nature if they identify and maintain a 
competitive advantage. 

b. Test Center Threats 

The significant threats identified through this industry analysis are 
outlined below. Each threat includes a brief description of the industry forces or 
indicators correlating to the threat. 

The test centers’ customer's tendency to conduct less testing represents a 
threat to test range infrastructure and the capability to support customers. As customers 
incorporate non-field test methods of verifying system requirements, the funding used to 
maintain the infrastructure and the justifications for test personnel wil] diminish. 

The customers’ tendency to use test centers less for their test expertise and 
more as support activities represents a threat to the technical positions and technical 
capability of the test ranges. As customers begin to take advantage of new policies 
allowing greater flexibility in how they test their systems, they are beginning to rely more 
on their development contractors than on test centers for test expertise. 

The political environment indicates the test and evaluation community's 
reputation as high-cost and problematic, threatens its ability to influence development of 
weapon systems. Policy makers' perceptions of a problematic test and evaluation 
community may lead to policies that hinder test centers’ ability to perform their missions. 

The incorporation of simulation and modeling initiatives pose a threat to 
the test centers’ future workload. The use of modeling and simulation is expected to 
reduce the requirement for field testing at the centers. This reduction in field work may 


reduce workload, and thus further reduce staffing and available funding. 


Decreasing budgets represent a threat to the test centers' ability to perform 
their mission. The combination of decreasing budgets and constant workload threatens 
their ability to maintain the resources required to support test requirements for all 
customers. 

The reduction in engineering resources also represents a threat. More- 
sophisticated technology in both the weapons systems and the instrumentation needed to 
test them requires significant technical capability. The loss of technical workforce 
strength may reduce the test centers' ability to meet the emerging technology 
requirements. 

Decreasing modernization funding also poses a threat to the test centers’ 
ability to execute support for their customers. As modernization funding decreases, the 
test centers are forced to prioritize modernization efforts. As more efforts remain 
unfunded, the test centers are less prepared to support new test requirements. 

There are threats to the customer base in the Close Combat Heavy (CCH), 
Close Combat Light (CCL), Intelligence and Electronic Warfare (EW), Communications 
(COM) test support areas. TECOM projections for support in these four areas show the 
largest negative growth potential at the Army test centers [See Table 6]. 

The Army's consolidation of testing under one command poses a threat to 
funding, staffing and equipment at the Army test centers. The consolidated ATEC could 
have a negative impact on the ability of the test ranges to support testing if there is a re- 
distribution of resources among the test centers and operational testers. 

Competition represents a significant threat to workload levels at all of the 


test centers. If the centers do not respond to increases in competition with increases in 
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efficiency and effectiveness, they will begin to lose workload and see a subsequent loss 


of personnel and other resources. 


C. COMPARISON OF ENVIRONMENTAL ASSESSMENTS 

(1) Factors Common to Both Assessments. A comparison of the threats and 
opportunities determined by all the test centers and my independent assessment indicated 
there were some common and unique factors among them all. All the opportunities 
identified by any assessment are presented in Table 7. Each opportunity is associated 
with the assessment(s) that identified it. The threats are presented in the same manner in 
Table 8. These tables presents the opportunities and threats that were identified in my 


assessment or any of the three test center assessments. 
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Table 8. Threats From All Assessments 
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The comparison of the assessments indicates that, even when the results from all 
the test centers are consolidated, they are incomplete when compared to a methodical 
structured assessment conducted by a non-expert. This comparison supports the view that 
without a methodical external environmental assessment the test may miss critical aspects 
of the external environment. It is postulated that a methodical assessment conducted by a 
core team of experts from the test centers would produce a much more detailed and 
accurate depiction of the external environment and, in turn, would be much more 
valuable to the test centers in their strategic planning efforts than their current informal 
methods. 

It is important to again note that none of the test centers did a dedicated external 
assessment; nor did they document their round table results, so the generalizations from 
the strategic plans and interviews may understate the extent of the test centers 


assessments. 
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VI. CONCLUSION AND RECOMMENDATIONS 


A. CONCLUSIONS 

Test ranges are not conducting formal external environmental assessments during 
their strategic planning processes. Rather, they are relying on opinions and advise from 
expert personnel during other strategic planning steps. Any external environmental 
assessment information is generated informally as a byproduct of the strategic planning 
process. The result is that some opportunities and threats have surfaced, while others with 
high potential have not been identified. 

To meet today’s challenging and competitive test and evaluation environment the 
first and possibly most important step towards implementing effective strategic planning 
is the development of effective external environmental assessments. The environmental 
analysis becomes the foundation for the entire strategic planning process. If the test 
centers continue to base their strategic planning efforts on impressionistic and informal 
environmental assessments they risk misidentifying or ignoring some critical changes in 
the test and evaluation industry. Without a more systematic environmental assessment, 
they will be unable to take advantage of the many opportunities the emerging 


environment offers, nor prepare for the threats it may present. 


B. RESEARCH QUESTIONS 

The research addressed a primary research question, as well as several secondary 
questions. The primary question was: To what extent do existing external environmental 
assessment efforts at the Army’s test centers adequately map the general and task 


environment? 
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The secondary questions were: 

(1) What is the potential environment for the Army’s test centers? What are the 
emerging trends and forces, and what issues need to be considered? 

(2) What external environmental data should be collected and considered? Are 
there any significant threats or opportunities that are not being addressed by the test 


centers? 


Ce RESEARCH QUESTION ANSWERS 

(1) To what extent do existing external environmental assessment efforts at 
the Army's test centers adequately map the general and task environment? Using their 
existing environmental assessment processes, the test centers are able to identify only the 
top level or highest visibility environmental factors. This limitation prevents the test 
centers from identifying the more subtle and often more significant factors. Identification 
of these factors would allow them to develop strategies that are more effective and 
establish a competitive edge over other test centers. 

(2) What is the potential environment for the Army’s test centers? What are 
the emerging trends and forces, and what issues need to be considered? The emerging 
environment at the test centers can be summarized in terms of the opportunities and 
threats associated with it. Table 9 provides a summary of the opportunities and threats 
confronting the test ranges. This summary represents the results of the authors external 


environmental assessment. 
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Table 9. Emerging Test Center Business Environment 


THREATS 
Decreasing Budget 
Increasing Competition 
Customer trend of less field testing 
Increased use of simulation and modeling 
Trend of declining budgets 

Trend of reduced engineering resources 
Test mission declining areas 

Army test command consolidation 
Trend towards increasing technology 
Trend towards decreasing technical staff 












(é)) What external environmental data should be collected and considered? 
Are there any significant threats or opportunities that are not being addressed by the test 
centers? The test centers do not collect or acquire any external environmental data to 
support an assessment. The test ranges should include a dedicated effort to methodically 
collect environment data in the following categories. 

a. Analyzing the test center customers in terms of who are they, why do 
they come, how are they changing, and whether there is potential for other customers. 

b. Analyzing the testing industry in terms of trends and forces (political, 
economical technological, and social), resource controllers (who are they, how are they 
changing), and competition and collaborators. 

The test centers should consider the impact of those factors identified in the 
independent assessment that are not currently being addressed. The factors not identified 


by any of the test centers are summarized in Table 10. 
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Table 10. Opportunities and Threats Not Addressed by the Test Centers 


Increasing competition Army test command consolidation 
Trend towards increasing technology 
Trend towards decreasing technical staff 


D. RECOMMENDATIONS 





The following recommendations are provided for development of external 
environmental assessments at Army and DoD test centers. 

(1) Test ranges should incorporate methodical external assessments using 
methods similar to Bryson's. This will provide the detailed, analytical reviews of the 
opportunities and threats required for effective strategic planning. 

(2) A continuous external environmental scanning effort should be 
incorporated. This effort, which should be an integral part of managers’ daily functions, 
would allow quick response to threats and opportunities as managers see them arise. For 
instance, an established set of data elements similar to those described in the independent 
assessment could be regularly monitored for the purpose of identifying trends and their 
potential affect on the test center. 

(3) The test centers should consider sharing their environmental assessments 
or conducting joint assessments. A joint effort would offer the perspective of multiple 
viewpoints and a more robust assessment, which ultimately would lead to better strategic 


planning and the possible identification of opportunities to partner. 
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(4) The TECOM should consider publishing strategic planning guidance to all 
their test centers that include a rigorous external environmental analysis. The guidance 


should mirror a methodical approach like Byrson’s. 


E. SUGGESTED FURTHER STUDIES 

Three areas of additional research are suggested. 

(1) Analyze the strategic planning process at the test ranges to identify critical 
areas of improvement that can facilitate better measurements and implementation. 

(2) Correlate the Army results of this thesis to the Navy and Air Force test 


centers. 
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APPENDIX A. WORKLOAD PROJECTION DATA 


Appendix A provides historical and projected workload data for each of the 3 test 


centers studied. 


The data was derived from the Test and Evaluation Command’s 


financial summary report [Ref. 15]. A key to the mission areas is provided after Table 11. 
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Table 11. WSMR Workload Projections 


cc 
7 
a 
== 
oak 


2 
40 
4 
6 


“le fae 
aaa 
= [ale 


1 


ae 
EE 
[7 | 


4 


RA ea ee 
bois 
Cais 

ae | 

oe | 
dias (ead 


les 


ae 207 | 19 
Ee 
is 


oS re) MN a ln | 4 - |N ]2 m~ |[o [w+ 
ro) 
op co + |ao | 2 = co |2 | Nn |B Lo 
co 
ea aE Wi LS le S ip | wo re) -) ip 
a Con ieee’ SEP | ce — a la Oo | 


o 
> 
LL 
o |X 
> 
LL 


Actual (1000's of Direct hrs) 


Mission Area 
Air Defense 





Ammunition 
Aviation 
Command 
and Control 
IEW 
ISM 


63 


Table 12. YPG Workload Projections 
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Projected (1000's of Direct hrs) 


Actual (1000's of Direct hrs) 


Table 13. ATC Workload Projections 
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APPENDIX B. STAFFING LEVEL DATA 


Appendix B provides the historical and projected staffing levels of each of the test 
centers studied. The data was derived from multiple Department of Defense’s, In-House 
RDT&E Activities -Management Analysis Reports. 
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Table 15. YPG Staffing Level Projections 
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Table 16. ATC Staffing Level Projections 
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APPENDIX C. EDUCATION LEVELS 


Appendix C provides the historical education levels at each of the test centers 
studied. The data was derived from multiple Department of Defense’s, In-House 
RDT&E Activities -Management Analysis Reports and the Armys 1995 through 1999 


MRTFEB Installation Financial Summary for WSMR, YPG and ATC . 
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APPENDIX D. FUNDING LEVELS 


Table 18. Test Center Funding Level Projections 
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